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Preface 



There are prominent moments in time where ongoing scientific work is interrup- 
ted for a moment and a more general perspective is sought. The symposion on 
Logic versus Approximation is dedicated to such a moment, namely to reflect 
influences of the scientific work of Michael M. Richter at the occasion of his 65th 
birthday. The present collection is a selection of contributions to this symposion. 

In focussing on today’s knowledge based systems we encounter two major 
paradigms of reasoning. There are on the one hand the logic-based approaches 
where ‘logic’ is to be understood in a rather broad sense. This approach is predo- 
minantly deployed in symbolic domains where numerical calculations are not the 
core challenge. Logic has without any doubt provided a powerful methodological 
tool. Progress in this area is mainly performed by refining the representation of 
structural aspects which results in a succession of models that should capture 
increasingly more aspects of the domain. This may be seen as an approximation 
process on the meta-level. 

There is also some weakness in the logic-based approach, though, which is 
already due to its very foundation. The semantic theory of truth by Tarski has 
explicitly eliminated personal influence on the validity of truth as well as the 
representation of dynamically changing variations of the ground terms inside 
the theory. It does not allow for adaptive individual behavior per se as it is for 
example explicitly required in the field of e-commerce. From a methodological 
point of view pragmatics is required as opposed to semantics. These aspects 
make it worth to include rather philosophical and foundational considerations 
as well. 

On the other hand we find approximation oriented reasoning. Methods of 
this kind are mainly applied in numerical domains where approximation is part 
of the scientific methodology itself. Here we again distinguish two different basic 
types, discrete and continuous domains. 

However, from a more abstract level all these approaches do focus on similar 
topics and arise on various levels such as problem modeling, inference and pro- 
blem solving mechanisms, algorithms and mathematical methods, mathematical 
relations between discrete and continuous properties, and are integrated in tools 
and applications. 

Research on both kinds of reasoning in these areas has mostly been conduc- 
ted independently so far. Whereas approaches based on discrete or continuous 
domains influence each other in a sometimes surprising way, influences between 
these and the symbolic approach have less intensely been studied. Especially the 
potentialities of an integration is certainly not understood to a satisfactory con- 
tent although the primary focus from an abstract point of view is on a similar 
topic. It requires an unifying vision to which all parts have to contribute from 
their own perspective. 




VI 



Preface 



Scientific work is necessarily always the construction of sense. Progress is by 
no means arbitrary, but always guided by a quest for a still better understanding 
of parts of the world. Such construction processes are essentially hermeneutical 
ones, and an emanating coherent understanding of isolated topics is only guaran- 
teed by a unifying view of a personal vision. Such a vision is especially provided 
by the research interests of Michael M. Richter that have influenced the overall 
perspective of the symposion. In this sense his scientific work was present all the 
time during the symposion. 

Michael M. Richter has exerted a wide influence on logic and computer 
science. Although his productive work is widely spread there are some gene- 
ral interests behind yet. A central interest is certainly in modelling structural 
aspects of reality for problem solving along with the search for adequate me- 
thodologies for this purpose. Michael M. Richter made significant contributions, 
however, to a wide variety of topics ranging from purely logical problems in mo- 
del theory and non-standard analysis to representation techniques in computer 
science that have finally emancipated themselves from their logical origins with 
special emphasis given on problems in artificial intelligence and knowledge-based 
systems. 

The symposion on Logic versus Approximation has brought insight into these 
different approaches and contributed to the emergence of a unifying perspective. 
At the same time it reflected the variety of Michael M. Richter’s scientific in- 
terests. The contributions to this volume range from logical problems, philoso- 
phical considerations, applications of mathematics and computer science to real 
world problems, programming methodologies up to current challenges in expert 
systems. 

The members of the organization and program committee especially wish to 
thank the authors for submitting their papers and responding to the feedback 
provided by the referees. We also wish to express our gratitude to the FAW- 
Forderkreis e. V. and the empolis GmbH for their valuable support. Finally, we 
are very grateful to the local organization team of the International Conference 
and Research Center for Computer Science at SchloB Dagstuhl for their profes- 
sionalism in handling the local arrangements. 

To honor Michael M. Richter the President of the University of Kaisers- 
lautern, Prof. Dr. Helmut J. Schmidt, in his diverting opening talk surveyed 
the creative powers of Michael M. Richter garnished with concise anecdotes on 
mutual personal experiences at Kaiserslautern University. To pay special tribute 
to the work of Michael M. Richter the scientific program of the symposion had 
been complemented by lively and inspiring after-dinner speeches by Franz Josef 
Radermacher und Paul Stahly. The surrondings of the International Conference 
Center of SchloB Dagstuhl provided the appropriate sphere and greatly helped 
in making the symposion a scientifically intriguing, socially enjoyable, and alto- 
gether most memorable occasion. This collection is meant to capture the essence 
of its scientific aspects. 



Kaiserslautern, December 2003 
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A True Unprovable Formula of Fuzzy Predicate 

Logic* 



Petr Hajek 



Institute of Computer Science 
Academy of Sciences of the Czech Republic 
Pod Vodarenskou vezi 2, 182 07 Prague 
Czech Republic 



Abstract. We construct a formula true in all models of the product 
fuzzy predicate logic over the standard product algebra on the unit real 
interval but unprovable in the product fuzzy logic (and hence having 
truth value less than 1 in some model over a non-standard linearly or- 
dered product algebra). Godel’s construction of a true unprovable for- 
mula of arithmetic is heavily used. 



1 Introduction 

Is true the same as provable? For classical logic, Godel’s completeness theorem 
says that a formula tp is provable in a theory T (over classical logic) iff (p is 
true in all models of T. On the other hand, if “true” does not mean “true in all 
models of the theory” but “true in the intended (standard model” , Godel’s first 
incompleteness theorem applies: if T is a recursively (computably) axiomatized 
arithmetic whose axioms are true in the structure N of natural numbers (the 
standard model of arithmetic) then there is a formula true in N but unprovable 
in T. Thus such arithmetic only approximates the truth. 

Pure classical logic (or the empty theory T with no special axioms) over 
classical logic does not distinguish any standard non-standard models. It has 
just two truth values: true and false. For fuzzy logic the situation is different 
since one can distinguish standard and non-standard algebras of truth functions 
of connectives. Fuzzy logic is a many valued logic, the standard set of truth 
values being the unit real interval [0, 1]. The truth values are ordered; one for- 
mula may be more true than another formula (comparative notion of truth). 
This formalizes truth of vague (imprecise) propositions (like “He is a tall man” , 
“This is a very big number”, “I shall come soon” etc.). Most often, fuzzy logic is 
truth-functional, i.e. works with truth functions of connectives. In particular, for 
basic fuzzy predicate logic BLN (see [1]) each continuous i-norm together with its 
residuum determines a standard algebra of truth functions. A continuous t-norm 
is a continuous binary operation * on the real unit square which is commuta- 
tive, associative, non-decreasing in each argument, having 1 for its unit element 

* Partial support of ITI (the project No. LN00A056 (ITI) of Ministry of Education 
(MSMT) of the Czech Republic) is recognized. 
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(x * 1 = x for all x) and having 0 for its zero element (x * 0 = 0 for all x) . Its 
residuum => is defined as follows: x =>■ y = max{z|x * z < y}. Any continuous 
t-norm can serve as the truth function of conjunction; then its residuum is taken 
to be the truth function of implication. This is the standard semantics of the 
basic fuzzy logic. 

General semantics is given by the class of BL-algebras. The definition is to 
be found e.g. in [1], see also below Sect. 2 Roughly, a BL-algebra is a (lattice)- 
ordered structure with a least element and a greatest element and two operations 
*,=> that “behave like continuous t-norms”. Each continuous t-norm with its 
residuum defines a standard BL-algebra. Given a predicate language I and BL- 
algebra L, an L-interpretation M of X consists of a crisp non-empty domain M 
and for each predicate P of an L-fuzzy relation (of the respective arity) on M. 1 
One gives a natural definition of the truth value IMIm « ( v being an evaluation 
of object variables by elements of M) in Tarski’s style by induction on the 
complexity of tp. For L being standard, IMIm.u is always defined; for general L 
one has to work with so-called safe interpretations, for which IMIm.w is total 
(defined for all <p). (For standard L each interpretation is safe.) Axioms and 
deduction rules of BLM can be found in [1]; this gives the notion of provability 
in BLM. The general completeness theorem says that a formula ip is provable in 
the basic fuzzy predicate logic BLM iff it is true (= has value 1) for each safe 
interpretation M over each linearly ordered -BL-algebra L and each evaluation 
v {p is a general BL- tautology). 

Call p a standard BL-tautology if p is true for each (safe) interpretation over 
each standard BL-algebra. And as Montagna showed [4], the set of all standard 
BL-tautologies is not arithmetical and hence is a proper subset of the set of 
all general tautologies. A simple example of a formula which is a standard BL- 
tautology but not a general BL-tautology is the formula 

(Vx)(<^&^) = [(Vx) ¥>&!/] (B) 

where x is not free in v. (A counterexample was found by F. Bou.) 

Now turn to the three well-known particular continuous t-norms, namely 
Godel t-norm (x*y = min(x, j/)), Lukasiewicz t-norm (x * y = max(0, x + y — 1)) 
and product t-norm (x * y = x ■ y) and the corresponding fuzzy predicate logics 
GV, LV, 77V. See [1] for details; now we only mention that the unique standard 
algebra of truth functions of each of those logics is given by the corresponding 
t-norm whereas general algebras of truth functions are algebras from the variety 
generated by the standard algebra, so-called MF-algebras, Godel algebras and 
product algebras respectively. Axioms are those of BLM extended by the axiom 
of idempotence of conjunction tp — > (pkp) for Godel logic, the axiom of double 
negation (-i-i^p — > p where -up is p — > 0) for Lukasiewicz logic and by two axioms 
presented below for product logic. All three logics have general completeness 
theorem (for formulas true in all safe interpretations over all linearly ordered 

1 This means that if P is n-ary then its interpretation is a mapping assigning to each 
n-tuple of elements of M an element of L the degree of membership of the tuple 
into the interpreting fuzzy relation. 
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respective algebras); for Godel logic standard tautologies coincide with general 
tautologies, for Lukasiewicz logic the set of standard tautologies is ^-complete 
(Ragaz), for product logic the set of standard tautologies is not arithmetical 
(Montagna). All three logics prove the formula ( 7? ) above (for GV and LV see 
[1], for 77V see below). The aim of the present paper is to exhibit a particular 
example of a formula being a standard but not general tautology of 77V (thus an 
unprovable standard tautology of 77V). As mentioned above, our formula will be 
a variant of Godel’s famous self-referential formula stating its own unprovability. 
But keep in mind that we are interested in pure (product) logic, not in a theory 
over this logic. To find such an example for Lukasiewicz predicate logic remains 
an open problem. 



2 The Product Predicate Logic 

Recall that a 777-algebra is a residuated lattice L = (7, A, V, *, =>, 0, 1) satisfying 
two additional identities 

x /\ y = x * (x => y) (divisibility), 

(x => y) V (y => x) = 1 (prelinearity). 

Define ~>x = x => 0. A 77-algebra (product algebra) is a 777-algebra satisfying, 
in addition the identities 



x A ->x = 0, 

->->x => (((a; * z) => (y * z )) =t- (x => y)) = 1. 

The standard 77-algebra [0, \}n is the unit real interval [0, 1] with its usual 
linear order (A,V being maximum and minimum), * being real product and 
x => y = 1 for x < y, x => y = y/x for x > y. [0, 1] yy is a linearly ordered 
77-algebra; each linearly ordered product algebra has Godel negation (->0 = 1 
and -ix = 0 for x > 0) and satisfies cancellation by a non-zero element: if x ^ 0 
and x* z < y * z then x < y. 

Axioms of the product predicate logic 77V are axioms of basic predicate fuzzy 
logic 777V (see [1]) plus two additional axioms corresponding to the above iden- 
tities, i.e. 



(ip A -«p) 0, 

'X ((O&x) (V’&x)) ->(¥>->• VO)- 

Deduction rules are modus ponens and generalization. 

Recall the general completeness: T b ip over 77V iff ip is true in each L-model 
of T for each linearly ordered product L. 

Caution: In 77V, the quantifiers are not interdefinable; for a unary predicate 
U, the equivalence (yx)U(x) = ->( 3 x)-iU(x) is not provable. Moreover, there is 
a model M in which both ->(\/x)U(x) and ->(3a;)-i7/(a:) are true (have value 1) 
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(U has a positive truth value for all objects, but the infimum of three values 
is 0). This was used in [2] to show that standard satisfiability in product logic 
is not arithmetical. Montagna improved my construction and showed that both 
satisfiability and tautologicity in both 77V and 777V is not arithmetical. We shall 
use Montagna’s construction in the next section. 



3 The Results 

Theorem 1. 77V proves the formula (Va.’)(v?&^) = [(\/x)pk:v\. 

Proof: We give a semantic proof. It suffices to show for each linearly ordered 
77-algebra L, for a n £ L ( n from an index set 7) and for each b £ L that 

inf(a ra * b) = (inf a n ) * b. 

n n 

Obviously, inf „ a n * b < inf„(a„ * b). Conversely, let (inf^a,,) *b < t for some 
t < b. Then t = b * (b => t); write d for b => 7; thus (inf„ a n ) *b < d*b and, by 
cancellation, inf n a n < d , hence for some n, a n < d, a n * b < d , inf(a n * b) < t. 
For t = inf (a n * b) we get a contradiction. □ 

In the rest of this section we shall construct a formula which is a standard 
tautology of 77V but not a general tautology of 77V. We heavily use Montagna’s 
construction from [4]. The reader is assumed to have [4] at his disposal. 

P is a finite fragment of classical Peano arithmetic containing Robinson’s 
Q, expressed for simplicity in the logic without function symbols (thus having a 
ternary predicate A(x, y, x) for (the graph of) addition etc). 0 is the conjunction 
of the axioms of P. The language of P is called the arithmetical language. For 
each formula ip of the arithmetical language, y>° results from p by replacing 
each atomic formula by its double negation. U is a new unary predicate; <7 
is the conjunction of 0° with three axioms concerning U, namely ~<(\/x)U(x), 
-^(3x)~<U(x) and an axiom expressing that with increasing x (in the arithmetical 
sense) the truth degree of U (x) decreases quickly enough (Montagna’s (p 0 ,d> 2 ,d> 3 ; 
his <P i is not necessary since we work with 77V) . The following is the crucial fact 
about the construction: 

Lemma 1. (1) For each model M of the extended language over the standard 
product algebra such that ||?7 ||m > 0, each closed formula ip of the arithmetical 
language satisfies 



II'P°IIm = 1 iff N |= 

(N is the standard crisp model of arithmetic). 

(2) N has a [0, l]-valued expansion (N, £/ N ) to a model of >7 over the standard 
product algebra. 

Now we apply Godel-style diagonal lemma (cf. [3]). In P, aritlrmetize the 
language of 77V and let Prnw be the formal provability predicate of 77V expressed 
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in P. Construct an arithmetical formula v such that (P classically proves and 
hence) N satisfies the equivalence 

v = -^Pr n \/(\P ->• v°). 

(Recall that n is the n-tlr numeral; in P the above is a shorthand for the corre- 
sponding formula without function symbols.) 

Lemma 2. (1) 77V does not prove if - — > v° . (2) N f= v. (3) — > v° is a standard 

TTV-tautology. 

Proof: (1) Assume 77V b T — »• v°\ then the formulas <7, <7 — > v° , v° are true in 
(N, U N ) (have the value 1), hence N |= v and thus 77V \f <7 — > v° , a contradic- 
tion. 

(2) Since 77V 1/ <7 — > v° , N (= ^Prjjyi^P — > v°) and thus N \= v. 

(3) Let M be a model of 77V over the standard algebra. If ||^||m = 0 then 

1 1 if' — > i/°||m = 1; if II^IIm > 0 then ||i /0 ||m = 1 by Lemma 1 and hence ||if — > 

v° || M = 1. □ 

Main theorem. The formula <7 — »• v° is a standard 77V -tautology but not a 
general 77V -tautology. 

Proof: Immediate from the preceding lemma by the completeness theorem. □ 
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Abstract. This paper provides an overview of fuzzy systems from the 
viewpoint of similarity relations. Similarity relations turn out to be an 
appealing framework in which typical concepts and techniques applied 
in fuzzy systems and fuzzy control can be better understood and inter- 
preted. They can also be used to describe the indistinguishability inher- 
ent in any fuzzy system that cannot be avoided. 



1 Introduction 

In his seminal paper on fuzzy sets L.A. Zadelr [14] proposed to model vague 
concepts like big, small, young, near, far, that are very common in natural lan- 
guages, by fuzzy sets. The fundamental idea was to allow membership degrees 
to sets replacing the notion of crisp membership. So the starting point of fuzzy 
systems is the fuzzification of the mathematical concept € (is element of) . There- 
fore, a fuzzy set can be seen as generalized indicator function of a set. Where 
a indicator function can assume only the two values zero (standing for: is not 
element of the set) and one (standing for: is element of the set), fuzzy sets allow 
arbitrary membership degrees between zero and one. 

However, when we start to fuzzify the mathematical concept of being an 
element of a set, it seems obvious that we might also question the idea of crisp 
equality and generalize it to [0, l]-valued equalities, in order to reflect the concept 
of similarity. Figure 1 shows two fuzzy sets that are almost equal. From the 
extensional point of view, these fuzzy sets are definitely different. But from the 
intensional point of view in terms of modelling vague concepts they are almost 
equal. 

In the following we will discuss the idea of introducing the concept of (in- 
tensional) fuzzified equality (or similarity). We will review some results that on 
the one hand show that working with this kind of similarities leads to a better 
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Two fuzzy sets that are almost equal. 
Fig. 1 . Two similar fuzzy sets 



understanding of fuzzy systems and that these fuzzified equalities describe an 
inherent indistinguishability in fuzzy systems that cannot be overcome. 

2 Fuzzy Logic 

In classical logic the basics of the semantics part are truth functions for the 
logical connectives like -i, A, V, . 

Since classical logic deals with only two truth zero (false) and one (true), 
these truth functions can be defined in terms of simple tables as for instance for 
the logical connective A (AND): 



A : {0, 1} x {0, 1} — >■ {0, 1} 



A 


B 


aab 


0 


0 


0 


0 


1 


0 


1 


0 


0 


1 


1 


1 



In the context of fuzzy sets or fuzzy systems this restriction of a two-valued 
logic must be relaxed to [0, l]-valued logic. Therefore, the truth functions of the 
logical connectives must be extended from the set {0, 1} to the unit interval. 
Typical examples for generalized truth functions * : [0, 1] x [0, 1] — > [0, 1] for 
the logical AND A are: 



a * (3 


name 


min {a, /3} 


minimum 


max{a + (3 — 1, 0} 


Luksiewicz t-norm 


a ■ (3 


product 


j min{a, /3} if max{a, /3} = 1 
( 0 otherwise 


drastic product 




F. Klawonn and R. Kruse 



The axiomatic framework of t-norms provides a more systematic approach 
to extending A to [0, l]-valued logics. A t-norm * is a commutative, associative, 
binary operation on [0,1] with 1 as unit that is non-decreasing in its arguments. 
The dual concept for the logical connective OR V are t-conorms. A t-conorm 
* is a commutative, associative, binary operation on [0,1] with 0 as unit that 
is non-decreasing in its arguments. A t-norm * induces a t-conorm * by a*f3 = 
1 — ((1 — a) * (1 — (3)) and vice versa. 

In this paper, we will restrict our consideration to continuous t-norms. In 
this case, we can introduce the concept of residuatecl implication. — >■* is called 

residuated implication w.r.t. *, if 

a * (3 < 7 => a < (3 — >■* 7 

holds for all a, (3, 7 G [0, 1]. 

A continuous t-norm * has a unique residuated implication given by 
a — >■* (3 = \J {X G [0, 1] | a * A < (3}. 

The biimplication w.r.t. to the (residuated) implication — >■* is defined by 
ol -o-* (3 = (o — >■* /3) A (/3 — >■* o). 

The negation w.r.t. to the (residuated) implication — >■* is defined by 

“ua = a — 0. 



The most common examples for t-norms and induced logical connectives are: 
1. a* f3 = min{a, j3} 



2 . a * (3 



3 . a* f3 



ol — (3 — 
a ga = 



-1 a = 



1 if a < (3 

1 3 otherwise 

1 if a = f3 

min{a, /?} otherwise 

1 if a = 0 
0 otherwise 



max{a + (3 — 1, 0} 



a — > (3 = min{l — a + (3, 1} 
aGA/3=l — |a — (3\ 

-<a = 1 — a 



a ■ (3 



Cx — ^ [3 — 

OL GA /?) = 



-1 a = 



1 if a < (3 
— otherwise 

a. 



min{a,/3} 

max{a,/3} 



if a = (3 
otherwise 



f 1 if a = 0 
( 0 otherwise 
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If [A] denotes the truth value of the logical formula A , then the truth functions 
for quantifiers are given by 

[(VzXAOc))] = AM*))] and [(3z)(^(z))] = V[^))] 

X X 

It should be mentioned that these concepts of [0, l]-valued logics lead to in- 
teresting generalizations of classical logic from the purely mathematical point of 
view. However, the assumption of truth-functionality, i.e. that the truth value 
of a complex logical formula depends only on the truth values of its compound 
elements, leads to certain problems. Truth-functionality implies a certain inde- 
pendence assumption between the logical formulae. Like in probability theory, 
independence is a very strong assumption that is seldom satisfied in practical 
applications. 

Already the simple example of three- valued Lukasiewicz logic illustrates this 
problems. The third truth value u in this logic stands for undetermined. The 
logical connective A is defined canonically by the following truth function: 



* : {0, u, 1} x {0, u, 1} — > {0, it, 1} 



The following simple example shows the problem caused by truth function- 
ality. 



Proposition 

A 


Meaning 

The German chancellor will be in Berlin 
on 30 November 2010. 


[■■•] 

u 


B 


It will rain in Berlin on 30 November 
2010. 


u 


AAB 




u 


A A ->A 




0 



A and B are independent (hopefully). A and -i A are definitely not. So there 
is no consistent way of assigning a truth value to a logical conjunction of two 
statements based only on their truth values, since A , B and -<A all have the truth 
value undetermined , as well as the logical statement AAB , whereas AA~iA should 
be assigned the truth value false. 

However, in applications of fuzzy systems like fuzzy control this problem 
usually plays only a minor role, because certain independence assumptions are 
satisfied there by the structure of the considered formal framework. 
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3 Similarity Relations 

Before introducing the notion fuzzified equality or similarity, we briefly review 
how mathematical concepts can be fuzzified in a straight forward way. 

We interpret the membership degree y(x) of an element a; to a fuzzy set /i 
as the truth value of the statement x is an element of y. 

M(») = [x e lA 

When we want to consider the fuzzified version of an axiom A (in classical 
logic), we take into account that axioms are assumed to be true, i.e. [A] = 1. 
Also, axioms are very often of the form B — > C . Using residuated implications, 
we have 



[B -> C\ = 1 ^ [B] < [C] 

Having these facts in mind, it is obvious how to interpret an axiom in a [0, 1]- 
valued logic. As a concrete example, we consider the notion of equivalence rela- 
tions. 



classical logic 


fuzzy logic 


relation: 


fuzzy relation: 


ECXxX 


E: X x X — > [0, 1] 


(x, x) € E 


bd 

H 

II 

i — 1 


(x,y) e E => (y,x) <E E 


E{x,y) < E(y,x) (thus E(x,y) = E(y,x)) 


(x, y) G E A (y,z) G E => (x, z) £ E 


E(x,y) * E(y,z) < E(x,z) 



A fuzzy relation 



E : X x X — >[0,1] 

on a set X satisfying the three previously mentioned axioms is called an simi- 
larity relation [15,11]. Depending on the choice of the operation *, sometimes 
E is also called an indistinguishability operator [13], fuzzy equality (relation) [2, 
7], fuzzy equivalence relation [12] or proximity relation [1], 

A fuzzy relation E is a similarity relation w.r.t. the Lukasiewicz t-norm, if 
and only if 1 — E is a pseudo- metric bounded by 1. A fuzzy relation E is an 
similarity relation w.r.t. the minimum, if and only if 1 — £7 is an ultra-pseudo- 
metric bounded by 1. Any (ultra-)pseudo-metric 5 bounded by 1 induces an 
similarity relation w.r.t. the Lukasiewicz t-norm (minimum) by E = 1 — <5. 

Extensionality in the context of similarity relation means to respect the sim- 
ilarity relation: Equal (similar) elements should lead to equal (similar) results. 
The classical property: x £ M A x = y => y £ M leads to the following 
definition. 
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A fuzzy set y is called extensional w.r.t. an similarity relation E, if 

^0) * E(x, y) < n(y) 



holds. 

Let E : X x X — > [0, 1] be an similarity relation on the set X. The extensional 
hull fi of the fuzzy set y is smallest extensional fuzzy set containing y given by 

A (y) = V (M*) * E ( x ,y))- 

x€X 



y £ y <f=> ( 3x £ X)(x £ y A x = y) 

The extensional hull of an ordinary set is the extensional hull of its indicator 
function and can be understood as the (fuzzy) set of points that are equal to at 
least one element in the set. 

As an example consider the similarity relation E(x,y) = 1 — min{|.'E — y |, 1}. 
The extensional hulls of a single point and an interval are shown in figure 2. 




Fig. 2. The extensional hulls of the point xo and of the interval [a, b ]. 



Extensional hulls of points w.r.t. 

E(x,y) = 1 - min{|a: - y |, 1} 

always have a support of length two. In order to maintain the degrees of similarity 
(and the membership degrees), when changing the measurement unit (seconds 
instead of hours, miles instead of kilometers,. . . ), we have to take a scaling into 
account : 



E(x,y) = 1 — min{c • \x - y\,l} 

When we take a closer look at the concept of similarity relations, we can even 
introduce a more general concept of scaling. Similarity relations can be used to 
model indistinguishability. There are two kinds of indistinguishability, we have 
to deal with in typical fuzzy control applications. 
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Enforced indistinguishability is caused by limited precision of measurement 
instruments, (imprecise) indirect measurements, noisy data, . . . 

Intended indistinguishability means that the control expert is not interested 
in more precise values, since a higher precision would not really lead to an 
improved control. 

Both kinds of indistinguishability might need a local scaling as the following 
example of designing an air conditioning system shows. 



temperature 
(in °C) 


scaling 

factor 


interpretation 


< 15 


0.00 


exact value meaningless (much too cold) 


15-19 


0.25 


too cold, but not too far away from the desired temper- 
ature, regulation need not be too sensitive 


19-23 


1.50 


very sensitive, near the optimal value 


23-27 


0.25 


too warm, but not too far away from the desired tem- 
perature, regulation need not be too sensitive 


> 27 


0.00 


exact value meaningless (much too hot) 



When we apply these different scaling factors to our temperature domain, this 
has the following consequences, when we consider the similarity relation induced 
by the scaled distance. In order to determine how dissimilar two temperatures 
are, we do note compute their difference directly, but in the scaled domain, where 
the range up to 15 is shrunk to a single point, the range between 15 and 19 is 
shrunk by the factor 0.25, the range between 19 and 23 is stretched by the factor 
1.5 and so on. The following table shows the scaled distances of some example 
values for the temperature. 



pair of 


seal. 


transformed 


similarity 


values 


factor 


distance 


degree 


0 ,y) 


c 


6(x,y) = \c-x-c-y\ 


E(x,y) = 1 -min{£(a;,y),l} 


(13,14) 


0.00 


0.000 


1.000 


(14,14.5) 


0.00 


0.000 


1.000 


(17,17.5) 


0.25 


0.125 


0.875 


(20,20.5) 


1.50 


0.750 


0.250 


(21,22) 


1.50 


1.500 


0.000 


(24,24.5) 


0.25 


0.125 


0.875 


(28,28.5) 


0.00 


0.000 


1.000 



Figures 3 and 4 show examples of extensional hulls of single points. 

The idea of piecewise constant scaling functions can be extended to arbitrary 
scaling functions in the following way [4]. Given an integrable scaling function: 
c : R — > [0, oo). If we assume that we have for small values e that the transformed 
distance between x and x + e is given by 
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Fig. 3. The extensional hulls of the points 15, 19, 21, 23 and 27. 




Fig. 4. The extensional hulls of the points 18.5 and 22.5. 



then the transformed distance induced by the scaling function c can be computed 

by 



c(s) ds 



4 The Inherent Indistinguishability in Fuzzy Systems 

In this section we present some results [4,6,5] on the connection between fuzzy 
sets and similarity relations. 

Given a set A of fuzzy sets (’a fuzzy partition’). Is there an similarity relation 
E s.t. all these fuzzy sets are extensional w.r.t. El The answer to this question 
is positive. 



E A (x,y) = f\ (/z(x) o n(y)) 

is the coarsest similarity relation making all fuzzy sets in A extensional. 

We go a step further and consider a given set A of normal fuzzy sets (that 
have membership degree one for at least one point). Is there an similarity relation 
E s.t. all these fuzzy sets can be interpreted as extensional hulls of points? 
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Let A be a set of fuzzy sets such that for each /j, G A there exists x M € X 
with /x( x M ) = 1. There is an similarity relation E, such that for all /x G A the 
extensional hull of the point x ^ coincides with the fuzzy set /x, if and only if 

V (M*) * "( x )) < A (My) ° v (y)) 

xex yex 

holds for all /x, v £ A. 

In this case, E = E ^ is the coarsest similarity relation for which the fuzzy 
sets in A can be interpreted as extensional hulls of points. 

If the fuzzy sets are pairwise disjoint {fi(x) * v(x) = 0 for all x), then the 
condition of the previous theorem is always satisfied. For the Lukasiewicz t-norm 
this means 



/x(x) + v{x) < 1. 



Let A be a non-empty, at most countable set of fuzzy sets such that each 
/x £ A satisfies: 

— There exists x p € R with /x( x = 1. 

— /x (as a real- valued function) is increasing on (— oo,x M ]. 

— /x is decreasing on [x^, — 00 ). 

— /x is continuous. 

— fj, is differentiable almost everywhere. 



There exists a scaling function c : R — > [0, 00 ) such that for all fj, £ A the 
extensional hull of the point x ^ w.r.t. the similarity relation 



E(x,y) = 1 — min 



c(s) ds 



coincides with the fuzzy set /x, if and only if 



min{/x(x), v{x)} > 0 => 



d/x(x) 




dv(x) 


dx 




dx 



holds for all /x, v £ A almost everywhere. In this case, 



c : R — > [0, 00 ), 



x i-)- 



dfi(x) 

dx 



0 



if /x(x) > 0 
otherwise 



can be chosen as the (almost everywhere well-defined) scaling function. 

Figure 5 shows a typical example of a choice of fuzzy sets. For this kind 
of fuzzy partition a scaling function exists, such that the fuzzy sets can be 
represented as extensional hulls of points. 

There is another explanation, why fuzzy sets are very often chosen as shown 
in this figure. The expert who specifies the fuzzy sets and the rules for the fuzzy 
system is assumed to specify as few rules as possible. When he has chosen one 
point (inducing a fuzzy set as its extensional hull), taking the similarity relations 
into account, this single point provides some information for all points that 
have non-zero similarity /indistinguishability to the specified point. Therefore, 
the next point must be specified, when the similarity degree (membership degree 
of the corresponding fuzzy set) has dropped to zero. 
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Fig. 5. Fuzzy sets for which a scaling function can be defined. 



5 Similarity Relations and Fuzzy Functions 

If we assume that the fuzzy sets in fuzzy control applications represent (vague) 
points, then each rule specifies a point on the graph of the control function. A 
rule is typically of the form 

If x i is y i and . . . and x n is y n , then y is v. 

where xi, . . > ,x n are input variables and y is the output variable and yi, . . . ,y n 
and v are suitable fuzzy sets. 

In this way, fuzzy control can be seen as interpolation in the presence of vague 
environments characterized by similarity relations. A function / : X — > Y is 
extensional w.r.t. to the similarity relations E and F on X and Y, respectively, 
if 



E(x,x') < F(f(x),f(x')) 



holds for all x, x' € X. 

Interpreting fuzzy control in this way, defuzzification means to find an exten- 
sional function that passes through the points specified by the rule base. It can 
be shown [10] that the centre of gravity defuzzification method is a reasonable 
heuristic technique, when the fuzzy sets and the rules are ’well-behaved’. From 
a theoretical point of view, we have to find a function through the given control 
points that is Lipschitz continuous (w.r.t. the metrics induced by the equality 
relations) with Lipschitz constant 1. 

Since fuzzy controllers usually have multiple inputs, it is necessary to combine 
the similarity relations to a single similarity relation in the product space. The 
canonical similarity relation on a product space is given by [9] 

E((x x,... ,x p ),(x[,... ,x')) = min {£)(£*, a;')}. 

ie{i,... ,p} 

In terms of fuzzy control this means that for a single rule, the membership 
degrees of an input would be combined using the minimum. 

Viewing fuzzy control in this way, the specification of (independent) fuzzy 
sets respectively similarity relations means that the indistinguishabilities on the 
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different inputs are independent. Although this is an unrealistic assumption, 
fuzzy control works quite well. The independence problem is partly solved, by 
using a fine granularity everywhere and specifying more rules. 

Finally, we would like to emphasize that, even if the fuzzy sets are chosen 
in such a way that they cannot be interpreted as extensional hulls of points, 
similarity relations play an important role. We can always compute the coarsest 
similarity relations making all fuzzy sets extensional. It can be shown under 
quite general assumptions [6] that 

— the output of a fuzzy system does not change, when we replace the input by 
its extensional hull and 

— the output (before defuzzification) is always extensional. 

6 Conclusions 

We have shown that similarity relations provide an interesting framework to bet- 
ter understand the concepts underlying fuzzy systems and fuzzy control. They 
can also be used to characterize the indistinguishability that is inherent in any 
fuzzy system. Exploiting the ideas of the connection between fuzzy systems and 
similarity relations further leads also to interesting connections to fuzzy cluster- 
ing [3] and to understanding fuzzy control as knowledge-based interpolation [8] 
which leads to a much stricter framework of fuzzy systems in which inconsisten- 
cies can be avoided easier [5] 
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Abstract. A quantified Boolean formula is true, if for any existentially 
quantified variable there exists a Boolean function depending on the 
preceding universal variables, such that substituting the existential 
variables by the Boolean functions results in a true formula. We call a 
satisfying set of Boolean functions a model. In this paper, we investigate 
for various classes of quantified Boolean formulas and various classes of 
Boolean functions the problem whether a model exists. Furthermore, for 
these classes the complexity of the model checking problem - whether a 
set of Boolean functions is a model for a formula - will be shown. Finally, 
for classes of Boolean functions we establish some characterizations in 
terms of quantified Boolean formulas which have such a model. For 
example, roughly speaking any satisfiable quantified Boolean Horn 
formula can be satisfied by monomials and vice versa. 

Keywords: quantified Boolean formula, Boolean function, model check- 
ing, complexity, satisfiability 



1 Introduction 

Quantified Boolean formulas ( QBF) are a powerful tool for the representation of 
many problems in computer science and artificial intelligence such as planning, 
abcluctive reasoning, non-monotonic reasoning, intuitionistic and modal logics. 
This has motivated to design efficient decision algorithms for QBF or to look for 
tractable subclasses of QBF which are still able to formulate some interesting 
problems in practice. 

The most natural approach to determine the truth of a QBF formula is based 
on the semantics. In other words, this procedure iteratively splits the formula 
QxF of the problem into two simpler formulas <P[x = 1] and <P[x = 0]. Some 
improvements for this approach by using various backtracking strategies have 
been made [2, 4, 6, 9]. 

Another method for solving the satisfiability problem for QBFis the Q- 
resolution which is the generalization of the resolution approach for propositional 
formulas [7,5]. 



W. Lenski (Ed.): Logic versus Approximation, LNCS 3075, pp. 18—32, 2004. 
(c) Springer- Verlag Berlin Heidelberg 2004 
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Quantified Boolean formulas can be used to describe games. Let us con- 
sider a simple game. = \/x\3yi ■ ■ ■ \/x n By n G(x\, yi, ■ ■ ■ , x n , y n ) may describe 
a two-person game, where x t is the i— the move of the first player and yj is 
the j-th move of the second player. The moves are 0 or 1. The propositional 
formula G(xi, y\, • • ■ , x n , y n ) may represent the situation that for the moves 
Xi, 2 / 1 , • • - ,x n , y n player 2 wins the game. 

Now several questions arise: The first question is whether there exists a win- 
ning strategy for player 2. That means, we have to decide whether the quantified 
Boolean formula is true. # is true, if there is an assignment of truth values to the 
existentially quantified variables depending on the preceding universally quanti- 
fied variables, such that the formula G(x±,yi, • • • , x n , y n ) is true or in other words 
a tautology. The assignment to the existentially quantified variables can be ex- 
pressed in terms of Boolean functions. We denote the set of satisfying Boolean 
functions as a model. The term model is chosen, because a propositional formula 
<j) over the variables x±, - ■ ■ ,x n is satisfiable if and only if 3x± • ■ ■ 3 x n <j) is true. 
Often, a satisfying truth assignment for <fr is called a model. For formulas in first 
order logic, a model for a formula assigns besides the assignments for predicates, 
the domain etc. functions to function symbols and via skolemization functions 
to existential variables. In terms of games or other applications one may replace 
the term model by strategies, policies, or plan of actions. 

In general, the problem whether a quantified Boolean formula has a model 
is equivalent to the satisfiability problem for quantified Boolean formulas and 
therefore PSPA CZ?-complete [10]. 

With respect to the game, now the question is, whether there is a sequence 
of moves, or in other words Boolean functions, which may fulfill further require- 
ments or belong to a fixed class of Boolean functions. That leads to the problem 
whether for a fixed class of Boolean functions there is a model for the formula 
within this class. 

Suppose, we have a strategy in mind, say the Boolean functions /i, • • • , /„. 
We want to see whether this set of functions is a model for <P. This is denoted 
as the model checking problem. More general, we have to decide whether for a 
given formula a set of Boolean functions M is a model. 

The last question is the following: Suppose, we take ^ from a subclass of 
quantified Boolean formulas, for example quantified Horn formulas QHORN. Can 
we always find simple models, say for example Boolean functions represented as 
monomials? For QHORN we know that for any satisfiable formula a model in 
terms of monomials can be found. 

The other way round, for a given class of Boolean functions K we want 
to determine the set of quantified Boolean formulas which can be satisfied by 
models consisting of functions in K . 

Using Boolean functions as models may lead to some confusion, because the 
functions can be represented by truth tables, propositional formulas or quantified 
Boolean formulas with free variables. The representation may have an essential 
effect on the complexity of the various problems. In general, truth tables require 
more space than propositional formulas and propositional formulas more space 
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than quantified Boolean formulas with free variables. Subsequently, up to the 
last subsection, we demand that Boolean functions are given as propositional 
formulas. 

Without any restrictions to the Boolean functions and to the quantified 
Boolean formulas the model problem is PSPACE-complete, whereas we will see 
that the model checking problem is co AP-complete. An overview of the main 
results will be presented at the beginning of Section 5. 

2 Quantified Boolean Formulas 

In this section we recall the basic notions for propositional and quantified 
Boolean formulas and introduce some terminology. 

A literal is a propositional variable or a negated variable. Clauses are disjunc- 
tions of literals. A CNF formula is a conjunction of clauses. For CNF formulas 
with clause-length less or equal than k, we write k-CNF. HORN is the set of 
Horn formulas. That means, any clause contains at most one non-negated literal. 
DNF is the set of propositional formulas in disjunctive normal form. 

A QBF formula F is a quantified Boolean formula without free variables. The 
formula F is in prenex normal form, if F = Q\X\ ■ ■ ■ Q n x n (j), where Q t £ {V, 3} 
and 4> is a propositional formula over variables aq, • • • , x n . Q\X\ ■ ■ ■ Q n x n is called 
the prefix and (f) the matrix of F. Usually, we simply write F = Q(f>. 

A literal x or -ix is called a universal resp. existential literal, if the variable 
x is bounded by a universal quantifier resp. by an existential quantifier. Uni- 
versally resp. existentially quantified variables are also denoted as V-variables 
resp. 3-variables. A clause containing only V-literals is called universal clause or 
V-disj unction. 

QCNF denotes the class of QBF formulas with matrix in CNF. 

Definition 1. LetF = Q(a \A---Aa n ) andF' = Q(a , i be two formulas 

in QCNF. If ol\ is a subclause of ai for every i, then we write F’ C c i F. We say 
F' is a subclause-subformula of F. 

For example, we have \/xVz3y(zVy) A (~ix V~>y) C c NxVz3y(x\/ zVy) /\(~ix\/^y). 

A closed formula F £ QCNF is called satisfiable or true, if there exists an 
assignment of truth values to the existential variables depending on the preceding 
universal variables, such that the propositional kernel of the formula is true. For 
F = \/x3y(x V y) A (~ix V ~>y) choosing for the value of y the value of -<x the 
formula (-ixVy)A(xV~>y) is true. The assignment can be considered as a function 
f(x) = -ix. 

For quantified Boolean formulas with free variables, denoted as QBF* , the 
formula is satisfiable if, and only if there is a truth assignment for the free 
variables, such that for the truth assignment the closed QBF is true. We write 
F(x i, • • • , x n ) = Q(f>{x i, • • • , x n ) for a QCNF*, if Q is the prefix, <j> is the kernel, 
and x\, ■ ■ ■ , x n are the free variables. For example, the formula Fix) = Vz3y(z V 
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y) A (a: V ->y) has the free variable x and is satisfiable, because for x = 1 we 
obtain the satisfiable formula F' = Mz3y(z V y). 

In general, we assume that any QCNF input formula contains no tautological 
clause. With respect to the satisfiability, in formulas of the form F = Q\/x<f> we 
can remove the universal quantification \/x in the prefix and delete all occurrences 
of x preserving the satisfiability, if x is not a unit clause in (f>. In that case F is 
not true. 

In our investigations we make use of substitutions of variables by 
formulas. For a formula F{x\,---,x n ) with or without free variables 
F(x\ ■ ■ ■ , x n ) [2/1//1 , • • • , y n /f n ] denotes the formula obtained by simultaniously 
substituting the occurrences of the variables yt by the formula fa. For exam- 
ple, F(z)[y /~ «] = V#3 y(z V x V y) A (~<x V ^y)[y/^x\ results in the formula 
F'{z) = \/x3y(z V x V ~ <x ) A (~<x V x). In F'(z) we can delete the existential 
variable y in the prefix. 

For a formula F = Q<f> in QCNF, (f > | 3 is the propositional formula obtained 
from <f> by removing every V-literal. 

For a class X of propositional formulas QX denotes the class of quantified 
Boolean formulas in prefix normal form with matrix in X . For example, QHORN 
is the class of quantified Boolean Horn formulas. 

3 Boolean Models 

In this section we give a formal definition of models for quantified Boolean for- 
mulas without free variables and introduce the model and the model checking 
problem. In the remainder we show some basic results dealing with the complex- 
ity of these problems. 

Definition 2. (Model) 

Let F = Vzi3i/i • • ■'iz m 3y m (() be a satisfiable formula in QBF. For (1 < i < m) 
and Boolean functions f Vi (zi , ■ ■ ■ zf) we say M = (f yi , ■ ■ ■ , f Vm ) is a model for F 
if and only if 

Vzi ■ ■ ■ yz t (j)[yi/fy 1 (21), • • • , ym/fym On • • • , z m )] is true. 

If the Boolean functions fa belong to a class K of Boolean functions, then we 
say M is a K -model for F. 



Example 1. : 

The formula F = \/x3y(x V y) A (~<x V ->y) is true and for f y (x) = ->x, 

M = (fy) is a model, because 

Vx(x Vy) A (~>x v ~‘y)[y/ fy(x)] = Vx(x V f y (x)) A (->x V ~>f y (x)) = Vx{x\/^x) A 
(-■a; V a:) contains tautological clauses only. 

When not stated otherwise, we represent Boolean functions by propositional 
formulas. Only in the last subsection we consider another representation, namely 
quantified Boolean formulas with free variables.. 

Let K be a class of propositional formulas and X C QCNF. 
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K -Model Checking Problem for X: 

Instance: A formula £ X and M = (/i, • • • , /„) a sequence of 
propositional formulas /, £ K. 

Query: Is M a A'-model of <£? 

A'— Model Problem for X: 

Instance: A formula <P € X. 

Query: Does there exist a A'-model M for d>7 



The CJVF-model problem for QCNF is P SPACE- complete, since any Boolean 
function can be represented as a CNF formula. Therefore, to decide whether a 
formula has a model is equivalent to the question whether A is satisfiable. 
That problem is known to be PSP ACE- complete [7,10]. 

Lemma 1. The CNF-model checking problem for QCNF is coNP-complete. 

Proof: Let A = VaqElyi • • • Mx n 3y n <f be a formula in QCNF and M = 

(/i, • • • , f n ) be a sequence of propositional formulas for <F. Then M is a model 
for <F i.e. A' = Vaq • • • V£„</>[yi//i(aq), ■ ■ ■ ,y n /f n {xi, ■ ■ ■ ,x n )] is true if and only 
if the propositional formula 4>[y\/ fi{x\), • • • , y n / fn{x i, • • • , x n )] is a tautology. 
Since the tautology problem for propositional formulas is coNP -complete and 
W\ < |*P||M|, the model checking problem is in coNP. 

The coMP-hardness can be shown as follows: For <P = Vaq • • • Vx n 3y(y) and an 
arbitrary propositional formula / over the variables aq, • • ■ , x n , 

M = (/) is a model for <P i.e. Vaq • • • Vx n 3y : y[y/f(x i, • • • , x n )] is true if, and 
only if Vaq • • • \/x n f(x i, • • • , x n ) is true. That means /(aq, • • • , x n ) is a tautol- 
ogy. Hence, there is a reduction from the coNP - complete tautology problem for 
propositional formulas. ■ 



4 Characterizations 

For a class K of propositional formulas we want to characterize the class of 
QCNF formulas having a A'-model. Therefore, we introduce a relation Z(S,I\), 
where S C QCNF. We demand that any formula in S has a A'-model and that no 
proper subclause-subformula has such a model. That means, after removing an 
arbitrary occurrence of a literal in the formula the formula has no A'-model. In a 
certain sense, the formula must be minimal. Therefore, additionally we demand 
that any QCNF, for which a A'-model exists, contains a subclause-subformula 
in S. 

Definition 3. For a class of QCNF formulas S and a class of propositional 
formulas K we define: Z(S,K) holds if, and only if 

1. MF £ S: A has a K-model 

2. £ S \/<P' C c i $ : fL S 

3. MF : (4> has a K-model ==> =kJ>' C c , <P : <P' £ S). 
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For our desired characterization we need the following definition of minimal 
satisfiable formulas. 

Definition 4. MINSAT := {F £ QCNF \ F is true, V F' C c i F : F' is false}. 
For F £ MINSAT we say F is minimal satisfiable. 

For K C CNF, a quantified Boolean formula F is in K-MINSAT if and 
only if F has a K -model and for any F' C c i F : F' has no K -model. 



For example, the formula F = \/x\/z3y(zVxVy)A(->xV~<y) is not in MINSAT , 
because F is true and the subclause-subformula F' = \/x\!z3y(x V y) A (~<x V ~<y) 
is true, too. The formula F' is in MINSAT , because after removing an arbitrary 
literal from F l the formula is false. 

The class MINSAT is often used for the relation Z(S , K). For example, later 
on we will see that Z(QHORN n MINSAT , HORN) holds. 

Subsequently, we will show that in a certain sense for the relation Z(S,K) 
the classes S and K are unique, if one of them is fixed. For that reason we 
associate every propositional formula / with a QCNF formula Ff. 

Definition 5. Let f be a CNF formula. A CNF formida g is called minimal for 
f , if g ~ f and removing an arbitrary occurrence of a literal from g results in a 
formida not equivalent to f . 

Definition 6. (Associated QCNF formula Ff) 

We associate to every Boolean function f over x\, ■ ■ ■ , x n QCNF formulas Ff 
as follows: 

To the constant function 0 we associate the formida f>f := By ->y 
to the constant 1 we associate the formula Ff := 3 y y. 

Suppose f is not a constant. Let f \ cq be a minimal CNF formula for -if, and 
let /\ f3j be a minimal CNF formula for f. 

Then we define Ff := Vaq • • • \/x n 3y(f\(ai V y) A f\((dj V -<y)). 

Lemma 2. Suppose we have Z(S,K) for some K and S. Then {Ff\f £ K} C 

S. 

Proof: At first we show that M = (/) is a model for Ff. 

If / is a constant then obviously M is a model for Ff. If / is not a constant, 
then: 

M = (/) is a model for Ff if, and only if 

Vxi • • • Vx n 3y : Ai(a* V y) A A (Pj V ~<y)[y/f(x i,- • • ,x n )\ is true iff 

Vxi • • • Vx n 3y : ( A 4 V y) A ( A Pj V -iy) [y/f(xi , • • • , x n )] is true iff 

Vxi • • • Vx n : (A; OLi V f(x 1, • • • , x n )) A (A j (3j v -if(x 1, • • • , x n )) is true iff 

Vxi • • • \/x n : (~if(x i,- • -,x n )V f(x i,- • • ,x n )) A (f(x i,- • • ,x„) V ->f(x i, • • • ,x n )) 

is true. 



Since the last formula is a tautology, M is a model for Ff. 

Next we show that there is no satisfiable formula F' C c i Ff. Suppose the 
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contrary, there exists such subclause-subformula <&' . Please note, that / is not 
a constant. 

Case 1: some y is missing. 

= Vxi • • • Vx n 3y : (A V y) A a l0 A (A(/?j V - 2 /) 

The subclause ctj 0 is a non-tautological universal clause. Hence, the formula <P' 
is not true in contradiction to our assumption. 

Case 2: subclause a' io C a io for some i 0 . 

® = Vzi • • • Vz„3y(A i#io (a.i V y) A (a' o V y) A (A(/?j V ->y) 

Subcase: a' io is empty. 

Then the formula has the form <P' = Vaq • • ■Vx n 3y(/\ i , ig (ati\/y)A(y)A(f\(f3j\/-<y) 
Since the formula is true, the truth value of y must always be 1. That implies 
Vxi ■ ■ • Mx n A 0j is true. But then / is the constant 1 in contradiction to our 
assumption, because /\f3j ~ f. 

Subcase: a' ig is not empty. 

Then the propositional formula (Ai^i 0 a i A a' iQ ) V (A /A) mus t be a tautology. 
That means, the complement (Vi^i 0 _,a i V ->a^ 0 ) A (“ '( A Pj)) is unsatisfiable. 
Since f ~ /\ (3 j, the formula 

(Vi^i 0 v -, <A: 0 ) A (“'/) is unsatisfiable. Hence, we have ->/ |= (A^ io A a- 0 ). 
From the other side Aj^i 0 a i A a ?; 0 (= A» because a' o C c i cq; 0 . Therefore, we 
have A A Oi 0 H= “’/■ That is a contradiction to the minimality of A t ay for 
->/, since a' o is a proper subclause of ay 0 . 

Altogether, we have shown that no proper subclause-subformula of is true. 
Hence, d>f must be in S. 



Definition 7. For two classes of propositional formulas Ad and A ' 2 we define: 
K 1 ss A ' 2 if and only ifM f £ Ad 3g £ K 2 ■ f ~ <7 and idee versa. 



Lemma 3. (Uniqueness) 

1. VS 1 ; S 2 C QCNFMK C propositional formulas: Z(S\,K) and 

Z(S 2 ,K)=^ Si=S 2 

2. VS 1 C QCNF \/Ki,K 2 C propositional formulas: Z(S,Ki) and 
Z(S , A' 2 ) ==► Ad « A 2 



Proof: Ad 1: Suppose Z(S\,K) and Z(S2,K) are given, but Si yf S 2 . Let 
<P £ Si — S 2 . Then has a A'-model, because of A £ £ 1 . Since Z(S 2 , A'), there 
exists a subclause-subformula C cJ A with £ S 2 . 

Since has a A'-model, there is a formula A" C c ; <F' C cJ with A" £ Si. 

Because of the minimality of Si, see definition of Z part 2, we obtain d> = <P" 
and therefore A £ S 2 in contradiction to our assumption. 

Ad 2: Suppose we have Z(S, Ad), Z(S, A' 2 ) and Ad 76 AT 2 . Then there is without 
loss of generality a formula / £ Ad, for which no formula in A ' 2 is equivalent 
to /. Using lemma 2 we have <Ff £ S. Since for <d>f any model formula g is 
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equivalent to f and Z(S, K 2 ), there must be a model formula g £ I \2 equivalent 
to / in contradiction to our assumption. 

■ 

Based on the definition of the relation Z(S, K ) now we can formulate the so 
called characterization problems. 

Characterization Problems: 

1. For a given class of propositional formulas K determine the class S with 
Z(S,K). 

2. For a class S C QCNF fl MINSAT determine a minimum covering 
Si,-- - S n , respectively K\, - - - K n , such that S C (J . S t and Z(Si, A3). 



5 Classes of models 

In this section we investigate the A— model checking and AT-model problem for 
various classes K of Boolean functions given as propositional formulas or as 
quantified Boolean formulas with free variables. At first we define some classes 
K followed by an overview of known or later on proved complexity results. 

Definition 8. We define (x° = and x 1 = x) 

Kq := {/ | / is 0 or 1} 

K\ := {/ | 3z3e £ {0,1} : f(x 1 , ...,x n ) = x\, n £ N} U K 0 

I< 2 :={/ j 37 C : f(x i,...,x n ) = A i&1 x i, n£ N} U I< 0 



In the following tabular the first column contains classes K of Boolean func- 
tions. The last two rows are devoted two Boolean functions given as quan- 
tified Boolean formulas with free variables. The abbreviation P SPACE- c re- 
spectively NP-c and coNP-c stands for PS PACE- complete respectively NP- 
complete and coAP-complete. A-f is a class in the polynomial-time hierarchy 



Boolean functions K 


model checking 


model 


Z(S,I < ) 


CNF 


coNP-c 


PS PACE- c 


QCNF n MINSAT 


K 0 


linear time 


NP-c 


Ql-CNF n MINSAT 


Ki 


linear time 


NP-c 


Q2-CNF n MINSAT 


k 2 


quadratic time 


NP-c 


QHORN D MINSAT 


1-CNF 


co-NP-c 


Z 2 




1-DNF 


coNP-c 


z? 




2- CNF 


coNP-c 


z? 




HORN 


coNP-c 






2-HORN 


coNP-c 


ZZ 




QCNF* 


PSPACE-c 


P SPACE- c 




QHORN* 


coNP-c 
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defined as (k > 0): £q = 77(f = P the class of polytime solvable problems, 
£P +1 = NP s ^,njf +1 = co - £jf +1 . Thus, NP = £f and coNP = Tl[\ Relation- 
ships between prefix classes of QBF and classes of the polynomial-time hierarchy 
has been shown for example in [11]. 

The second and the third column states the complexity of the A'-model 
checking and the A'-model problem. In the last column the characterization S 
with Z(S,K) is listed. 



5.1 Basic Classes Ko and Ki 

We start with the class Kq , that means with constant functions 0 and 1. If we sub- 
stitute in a QCNF formula <F = Vaqdyi • • • Va ; n 3y n <f> the existential variables y, by 
some €i £ {0, 1}, then we obtain the formula <&' = \/x\ ■ ■ ■ Vx n 4>[yi/e\ , • • • , j/ n /e n ]. 
The formula F' is true if and only if <P* = <j)'[yi/ei, • • • ,y n /e n ] is a tautology, 
where <f>' is generated by removing any occurrence of literals over Xi in <f> . Hence, 
has a A' 0 -model if and only if <£| 3 = 3yi ■ ■ ■ 3y n ( has a A' 0 -model. 
Furthermore, a propositional formula <f> over the variables yi, ■ ■ ■ , y„ is satisfi- 
able if and only if 3yi ■ ■ ■ 3y n (j> £ QCNFnSAT i.e. 3yi ■ ■ ■ 3 y n <j) has a Ar 0 -model. 
These observations immediately imply the following propositions: 

1. The ATo-model checking problem for QCNF is solvable in linear time, whereas 
the A'o-model problem for QCNF is NP- complete. 

2. For every formula <F £ QCNF without tautological clauses: <F\^ £ SAT if 
and only if <P has a Ao-model. 

3. A formula <F = Q{a\ A • • • A a n ) £ QCNF has a A' 0 ~model if and only if 
every clause a* contains a literal A,; over an existential variable, such that 
Ai<i<„ L i is satishable. 

A'i-models, that means besides the constants 0 and 1, functions of the form 
f(x i, ... ,x n ) = x\ are closely related to the class Q2-CNF. That any satishable 
Q2-CNF formulas has a Ad -model follows immediately from the linear time 
algorithm deciding the satisfiability problem for Q2-CNF [8]. The other propo- 
sitions of the following theorem can be shown easily. A complete proof is given 
in [8], 

Theorem 1. ([ 8 ]) 

1. For QCNF, the K\-model checking problem is solvable in linear time and 
the Ki-model problem is NP-complete. 

2. Any formula <F £ Q2-CNFC SAT has a Ki-model. 

3. A formula £ QCNF has a I\i-model if, and only if there is some C c , 
$■.$'£ Q2-CNFH SAT . 



5.2 QHORN Versus K 2 

The class of quantified Boolean Horn formulas QHORN is one of the QBF classes 
for which the satisfiability problem is solvable in polynomial time. There exist 
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algorithms deciding the satisfiabilty problem in quadratic time [7] . In this section 
we present some results which show, besides the constants 0 and 1, that any satis- 
fiable QHORNhas monomials /(x i , • • • , x n ) = / \ ieI x.; as a model. Moreover, any 
QCNF formula having a A" 2 -model contains a satisfiable subclause-subformula 
in QHORN. 



Theorem 2. [8] 

1. The K 2 ~model checking problem for QCNF is solvable in quadratic time. 

2. The K 2 ~model problem for QCNF is NP-complete. 

3. Any formula <F £ QHORN fl SAT has a K 2 ~model and a 
K 2 ~model can be computed in polynomial time. 

f. A formula <P £ QCNF has a I\ 2 ~model if and only if there is some C c( : 
& £ QHORN n SAT . 

5. Z(QHORN n MINSAT , K 2 ) 

The intersection of two models Mi = (/i, • • • , f n ) and M 2 = (gi, ■ ■ ■ ,g n ) is 
defined as M ± D M 2 = (/1 A g u A g n ). 

For arbitrary formulas <F £ QCNF with two distinct models Mi and M 2 , in 
general the intersection Mi fl M 2 is not a model for <P. Take for example the 
formula. = 3x3 y[x V y) Then (x = l,y = 0) and (x = 0,y = 1) are distinct 
models for A, but the intersection M = (x = 0, y = 0) is not a model. 

For propositional Horn formulas the intersection of models, that means sat- 
isfying truth assignments, is a satisfying truth assignment, too. A similar result 
holds for QHORN. 



Theorem 3. For <F £ QHORN, if Mi = (/1, • • • , f r ) and M 2 = (<71, • • • , g r ) are 
models for T>, then Mi fl M 2 = (/1 A gi, ■ ■ ■ , f r A g r ) is a model for F. 

Proof: Let <P = Q(<f>i A • • • A (f> m ) £ QHORN be a formula with universal vari- 
ables Xi • • • , x q and existential variables yi ■ ■ ■ , y r . For h- t := fi A gi(l < i < r), 
it suffices to show that for the clauses </>j (1 < j < m), the propositional formula 
<j>j [yi/hi, ■ , y r /h r \ is a tautology. We proceed by a case distinction on the 
structure of Horn clauses. 

Case 1: (no positive 3-literal in <pj) 

Let 4>j = (w V \/ deD where w is a disjunction of V-literals in which at 

most one positive literal occurs and D C {1, • • • , r}. We obtain 
<t>'j ■= ,y r /h r \ = (wV\/ deD ^h d ) = (w V VdeD“'(/d A 9 d )) = 

( w V \/ deD ^fdS ~^g d ) 

Since is a model for d>, the formula <i>j[yi/ fi, ■ ■ ■ , y r / fr] — (w V \J dt z D _, /d) 
is a tautology. Hence, is a tautology. 

Case 2: (positive 3-variable yi in <j>j) Let < fij = (w V yi V Vdez? where w is 
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a disjunction of negative V-variables and 
DC {1, • • • , r}. We obtain 

4 >j ■= (t>j[yi/hi, ■ ■ -,y r /h r ] = (wV/ii V \/ deD h d ) = (roV (fihgi)V\/ d€D ->(fd A 

9d)) = 

(w V (/i A 51) V \J dGD (^f d V -tfd))) = (»V/iV \l deD hfd V --Sd))) A (w V V 
VdeD^fd v _, Pd)))- 

Since Mi and M 2 are models for <2>, ■ ■ ■ , y r /f r ] = (»V/iV \/ dGD ^fd) 

and 4 >j [yi/gi , • • • , y r /gr\ = (w V 31 V VdeD ~^ 9 d) are tautologies. Hence, ft is a 
tautology. ■ 



5.3 Classes 1-CNF, 1-DNF, 2— CNF, Horn, and 2— Horn 

In this section we investigate for further classes of propositional formulas the 
complexity of the model problem as well as the model checking problem. 

Lemma 4. For X £ {1-CNF, 1-DNF, 2- CNF, HORN, 2-HORN}, 
the X-model checking problem is coNP-complete, 

whereas for Y £ {1-CNF, 1-DNF, 2-CNF, 2-HORN} the Y-model problem is in 
EP. 

Proof: Model checking problem: That the various model checking problems are 
in coNP follows from the fact that the general C/VF-model checking is coNP- 
complete. 

At first we show the coNP-\ rardness for 1-CNF- models. The coNP- hardness 
follows from the following reduction of the tautology problem for propositional 
formulas in 3-DNF. We associate a = \J i <i<n {ln A la A ^3), where the kj are 
literals over the variables Xi, ■ ■ ■ , x m with the formula 



<p = \/xi ■ ■ ■ \/x m 3yi ■ ■ ■ 3 y n (j> with f> = {y 1 V • • • V y n ). 



For each y u we define f Vi (x 1 , • • • , x m ) = ( In A l i2 A l i3 ) and M = (f yi ,- ■ ■ , f y J. 
Clearly, &[yi/f yi (a;i, • • • , x m ), ■ ■ ■ , y n / f Vn {xi, ■ ■ ■ , x m )\ = Vxi •••Vx m a, and 
therefore M is a model of d> if, and only if a is a tautology. 

The coAP-hardness for the classes 2-CNF, HORN, 2-HORN follows, because 

1- CNF C 2-CNF, HORN, 2-HORN. 

The coNP- hardness for the 1-DNF- model checking problem can be shown sim- 
ilarly by associating with a the formula 

= Vzi • ■■\/x m 3y 1 ■ ■ ■ 3y n (f) with cf = V • • • V ->y n ). 

Model problem: 

At first we show: there is a polynomial p, such that if a formula d> has a 

2- CNF- model, then there is 2-CNF- model of length less than p(|4>|) 
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For n variables there exists at most 4 n 2 + 2 n different 2-clauses over these 
variables. Therefore, the maximum 2-CNF over n variables has length less than 
2 x (4n 2 +2n) . If a QCNF has n universal variables, then after the substitution of t 
occurrences of existential variables by some 2- 6WF-formula,s over these variables 
the length of the resulting formula is less or equal than |#| + t x (2 x (4n 2 + 2n)) < 
13|<Z>| 3 . 

Since 2-HORN and 1-CNF is a proper subset of 2-CNF an analogue proposition 
holds. 

That means, we can solve the model problem for 2-CNF respectively 2-HORN 
by non-deterministically guessing a proper sequence of formulas in 2-CNF re- 
spectively 2-HORN of length < 13|<£| 3 . In a second step we check whether the 
formulas build a model for <F. Since the model checking problems are in coNP 
we obtain our desired result. 

The proof for 1-DNF is similar to that for 1-CNF. Altogether, we see that the 
model checking problems are in ■ ■ 

For HORN formulas the number of different clauses over n variables can not 
be bounded by a polynomial in n. Therefore, we can not conclude as for 2-CNF 
that the HORN- model problem is A-f . 

It is an open problem whether there is a polynomial q such that any QCNF 
formulas <F, for which a HORN- model exists, has always a HORN- model of 
length less or equal than q ( |^|). 

5.4 QCNF* -Models 

In this section we discuss the case that the Boolean functions are given as quanti- 
fied Boolean formulas with free variables. It is well known that a Boolean function 
/ over the variables x\, ■ ■ ■ , x n can be represented as quantified Boolean formula 
with CNF kernel and free variables Xi, - ■ ■ , x n . For example 

■ ■ ,%n,n) = 3yi • • -3y n ((-u/i V • • • V ->y n ) A f\ (yiW ->Xij)) 



is logically equivalent to the propositional formula 

<P= /\ {~' x l,ji V ‘ ‘ ‘ V -' x n,j„) 

l<h,-,3n<n 

The length of ^(aqp, ■ ■ ■ , x n , n ) is 2 n 2 + 2 n, whereas tp has length n n+1 . 

In comparison to propositional formulas in some cases the length of the quan- 
tified Boolean formula with free variables is essentially shorter than the shortest 
CNF representation (see example above) . The set of quantified Boolean formulas 
with free variables is denoted as QCNF* . Now instead of substituting existen- 
tial variables by propositional formulas we replace the existential variables by 
formulas in QCNF* and adopt the A'-model definitions. Please note, that a sub- 
stitution of QCNF* formulas may lead to QBF formula not necessary in prenex 
normal form. But the resulting formula contains no free variables, since the free 
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variables of the substitute are bounded by the universal variables of the input 
formula. 

The question whether a quantified Boolean formula has a QCNF*- model 
is equivalent to the question whether the formula has a CWF-model, since any 
Boolean formula and therefore any CNF formula can be represented by a QCNF*- 
formula. That shows the PSPACE-completeness of the QCNF*-mode\ problem. 
On the other hand, the QVF-model checking is co AP-complete (see Lemma 1), 
whereas the QCNF* -model checking problem seems to be much harder. 

Lemma 5. The QCNF* -model checking problem is PSPACE-complete. 

Proof: The problem lies in PSPACE, because the substitution of the existential 
variables yi by quantified Boolean formulas with free variables in a formula 
<F leads to a quantified Boolean formula of lenglrt < |^|(I7j|^j|). The problem 
whether the resulting QBF formula is true, obviously is in PSPACE. 

Now it remains to show that the QCNF*-model checking problem is PSPACE- 
lrard. For the formula = 3y y and an arbitrary formula ip G QCNF: M = (ip) 
is a model for <P if and only if ip is true. Since the evaluation problem for QCNF 
is PSPACE- complete ([7,10]), the QCNF*-model checking problem is PSPACE- 
lrard. ■ 

Now we restrict ourselves to a subclass of QCNF* which has a satisfiability 
problem solvable in polynomial time. QCNF* formulas with a kernel in form of 
a propositional Horn formula are denoted as QHORN* -formulas. The formula 
given in the example above is in QHORN* . The following proposition states 
a known relationship between these formulas and propositional Horn formulas 
HORN. 

Proposition 1. (Horn equivalence) [7] 

1. V<2> G QHORN* 3F G HORN: <P « F, 

2. There exist formulas <F n G QHORN* for which any equivalent CNF formula 
has superpolynomial length. 

The next theorem shows that with respect to the complexity of the problems 
there is no big difference between Boolean functions represented as HORN and 
given as QHORN* formulas. 

Theorem 4. (QHORN* -models) 

1. The problem whether a QCNF formula has a QHORN* -model is as hard as 
the problem whether a Horn-model exists. 

2. The QHORN* -model checking problem is as hard as the HORN-model check- 
ing problem. (coNP-complete) 

Proof: Ad 1: Since any QHORN* formula with free variables xi,---,x n is 

equivalent to a HORN formula over these variables, a QCNF formula has a 
QHORN*-mode\ if, and only if the formula has a HORN- model. 

Ad 2: We will show that the problem is coAP-complete. 

The coNP- hardness of the QHORN* -model checking problem follows directly 
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from the co AP-completeness of the HORN- model checking problem, since every 
HORN formula is a QHORN* formula. 

Now it remains to show that the problem lies in coNP. Let be given a QCNF 
formula 

= \/zi3yi ■ ■ ■\/z n 3y n Ai <j< m A? anc l a proper sequence of QHORN* formulas 
M = (<p yi , • • • , p Vn ), where <p Vr has the free variables z\, ■ ■ ■ , z r . 

Next we establish a poly-time nou-determiuistic procedure for the complemen- 
tary problem, that M is not a model for <P. We have: M is not a model for <S> if 
and only if 



Vzi •• ■'iZn Ai<j<m Ajbi/Vyi^i),-'- ,yn/p yn (zir- ■ , z n )] is false if and only if 



3zi--- 3z n Vi<j<m -'4>j[yi/<Pvi(zi),- ■ -,yn/<Py n {z l, • • • , z n )] is true. 



Now we guess non-determiuistically a truth assignment for the variables 
Zi, ■ ■ ■ , 2 n , and replace the variables 2 , by these truth values. Then we obtain a 
QBF formula 

& := Vi<j<m _, ^'[2 /i/V i !/ 1 ) ■ ■ ' wliere tlie formulas ^ are the result 

of the replacing of the variables z-i by the truth values in ip yi (zi . ■ ■ ■ ,zi). These 
formulas are closed QHORN formulas. 

Now we show the poly-time solvability of the problem whether the formula F' 
is true. 

At first we compute the truth value of all the closed QHORN formulas <p' y .. 
That can be done in poly-time, since the evaluation (satisfiability) problem for 
QHORN is solvable in poly-time. Now we replace the formulas ip' y . in <P' by their 
truth values. The resulting formula is a propositional formula with the constants 
0 and 1, but without variables. The evaluation of whether the formula is true 
costs not more than linear time. 

If the result is true, then we know that is true and therefore M is not a model 
for <P. Further, if M is not a model, then there is an truth assignment for Zi for 
which is true. 

Hence, the QHORN* ~xno&e\ checking is in coNP. ■ 

6 Conclusions and Future Work 

This paper opens a new approach to explore quantified Boolean formulas by 
studying Boolean function models. Several issues remain for further work. Ac- 
tually, we do not know the complexity of the Horn-model problem and the 
QHORN*- model problem. For characterizations, the classes of QCNF formulas, 
which can be characterized by 1-CNF- models, 1-DNF— models, ^-CAF-models, 
2-HORN , etc. are not clear. In addition, models consisting of Boolean functions 
represented by quantified Boolean formulas with free variables are rather inter- 
esting, because of the space saving representations. 
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Abstract. The multiprocessor scheduling problem(MPSP), 
P\prec,pj = 1| Cmax, is known to be NP-complete. The problem 
is polynomially solvable, however, if the precedence relations are of the 
intree(outtree) type, P\intree(outtree),Pj = 1| Cmax, or if the number 
of processors is two, P2\prec,pj = 1| Cmax- In this paper, we introduce a 
parametric linear program which gives a lower bound for the makespan 
of MPSP and retrieves the makespans of the two polynomially solvable 
problems. 



1 Introduction 

Let G = (V,E) be an acyclic directed graph. We denote by V = {v±, . . . ,v n } 
the set of tasks, and by E the precedences between those tasks. A precedence 
e = ( Vi,Vj ) implies that the task Vj depends on the result of the task v t and Vi 
must be completed before Vj. If there is a path (vi,...,Vj) from v % to Vj in G, 
we say Vi is a predecessor of v 3 and Vj is a successor of i Let Predivi) and 
Succ(vi) denote the set of all predecessors and successors of u, consecutively. 

Furthermore let P = {p±, . . . ,p a } be a set of identical processors. Each task 
Vi can be processed by one of the processors p £ P in 1 unit time; therefore 
we can define a discrete set of time-steps r = {1, . . . ,n}. No two tasks can be 
assigned to the same processor at a time-step t. A schedule S = (xip, ...,x n , n ) 
is a mapping of V to r. We denote Xi t t = 1 when a task Vi is scheduled to a 
processor at the time-step t £ T and = 0 otherwise. 

The assignment constraints are defined as = 1 Vu; £ V which means 

each task should be processed once. The resource and precedence constraints are 

Xi,t + Jr - '■ Xj,t < 1 V(u», Vj) £ E and 

r. 

Additionally, we define a positive integer variable T such that the time con- 
straints Xi t t-t < T \/vi £ V and Vf £ T are satisfied. The multiprocessor 
scheduling problem (MPSP) seeks to minimize T such that the assignment, 
resource, time and precedence constraints are satisfied. 



E 



defined as , Xi t < cr 

Vi€:V 5 — 



Mt £ r and 



E 

t> 7 



W. Lenski (Ed.): Logic versus Approximation, LNCS 3075, pp. 33—42, 2004. 
(c) Springer- Verlag Berlin Heidelberg 2004 
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MPSP is formulated as: 



min T 






s.t. = 1 


Vvi g V 




Sv Xi <* - a 


vt e r 




Xi,ft < T 


Mvi G V 


& vt g r 


| \ X N + 5y X Lt < 1 


V(t >i,Vj) G E 


&V 7 G r 


%i,t G {0, 1} 


Vvi G V 


& vt g r 


T € IN. 







T*(to be clearer sometimes we write T*(G)), the optimal objective value of 
(1), is the makespan of MPSP which is the last time-step that a node in G 
is scheduled. A schedule S is valid if it satisfies (1) and S*, the optimal solu- 
tion corresponding to T*, is called the optimal schedule. Obviously, an optimal 
schedule must not be unique. 

MPSP is known to be NP-complete in general [9]. However, a number of 
special cases can be solved in polynomial time. In [7], Hu presented his ’’level 
algorithm” which is applied to solve MPSP when G is either an intree, i.e., each 
node in G has at most one immediate successor, or an outtree, i.e., each node in G 
has at most one immediate predecessor (if (v i,Vj) € E, then v 3 is the immediate 
successor of V{ and Vi is the immediate predecessor of Vj). 

Fuji, Kasami & Ninomiya [3] presented the first polynomial algorithm for 
MPSP when cr = 2 based on matching techniques. Coffman & Graham [1] gave 
another algorithm based on a lexicographic numbering scheme. The run-time of 
their algorithm was improved by Sethi [ 8 ], Gabow [4] and Gabow & Tarjan [5]. 

In this paper, we present a parametric linear program, which gives a lower 
bound for the makespan of MPSP and additionally provides the makespans of 
the cases G = intree(or outtree) and a = 2. This unifies the two methods, Hu’s 
level algorithm, HLA [7], and Highest level first algorithm, HLF [4]. 

The paper is organized as follows: In section 2 we introduce the parametric 
linear program, PLP, and show that it’s optimal objective value is a lower bound 
for the makespan of MPSP. In section 3 we present a modified version of HLA, 
and prove that applying PLP and HLA on intrees(or outtrees) we get the same 
makespan; therefore the bound found by PLP is tight. In section 4 we find the 
makespan of P2\prec,pj = l\C ma x using a modification of HLF and PLP. In 
section 5, the generalitry of PLP is outlined. Section 6 briefly summarizes the 
results and gives an outlook to further research. 

2 The Parametric Linear Program(PLP) 

Definition 1. PLP is defined as: 

minT s.t. V{\) = (LP(1) D {x i>t = 0 W; G V,Vi > A}) 
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where LP(1) is the linear relaxation of (1) and X is an integer parameter. Let 
X = (# 1 , 1 , ...,x n , n ) £ 'P(A) and A* be the smallest integer such that V(X*) is not 
empty. To be clearer, we write sometimes A *(G) = A*. 

Definition 2. The following terminologies are used throughout this paper. 

— CP: critical path of G = longest path in G; and CP(G ) = length{CP). 

— length (— > vf): length of the longest path from any node in G to Vi £ G. 

— length(vi —>): length of the longest path from Vi £ G to any node in G. 

— a(vi) = length vf) + 1; afvi) = lengthfut — >); 

— a = a(G) = CP(G) + 1. 

— Uk = {vi\vi€V & a(v j) = k} \/k = 1, a. 

Lk = {vi\vi € V & a — a(vi ) = k} \/k = 1, a. 

Uk and Lk were introduced for the first time by Fernandez & Bussel [2]. It 's 
obvious that Uk(and Lk) are a nonempty disjoint partitions ofV where 

U=(U£ =1 [/ fe ) = (U£ =1 L fc ). 

Each Uk(or Lk) is called the successive level of Ui (respectively Li) if l < k. 
Uk(or Lk) is called the direct successive level of Uk-i(or Lk- 1 ) for k = 
2, ...,a. 

— Decomposition of G = {V, E) : Let V = Vi U V 2 . G can be decomposed into 
two graphs G\ = (V\, E\) and Gn — ( V 2 , E 2 ) such that E\ = E\{e\e £ E has 
both end points in Vi} and E 2 = £’\{e|e £ E has both end points in V)}. 

We start with some lemmas to prove that A* is a lower bound for T*. 

Lemma 1. LetV( Ai) yf 0. Then for any X = (x u , x n , n ) £ 'P(Ai): 

x i,u “t - “t - X'i i — 1 £ V, 

where u = a(vi) and l = Ai — a(vi). 

In other words, Xi tt = 0 Vt = 1 , u — 1 & t = l + 1, ..., X\. 

Proof. We do the proof by induction. Let u = a(vf) = 2, therefore 
length( —> Vi ) = 1. Let ( Vj,Vi ) £ E be this longest path. 

Precedence constraints => Xj t i + ... + Xj, n + Xi t 1 < 1 
Assignment constraints => Xj t i + ... + Xj >n =1 

Let u = a(vi) and suppose the hypothesis holds for all Vj with a(vj) < u. 
Let (...,Vj,Vi) be the longest path from any node in G to 1 It’s obvious that 
a(vj) = u — 1. 

Precedence constraints => Xj tU - 1 +... + Xj tn + Xi t \ + ... + Xi tU - 1 < 1 ^ 
Assignment constraints => Xj \ +... + Xj n = 1 > => 

Hypothesis => x ht = 0 Vt = 1, ..., u — 2 J 

X'i.t — 0 Vt — 1, ..., U 1 = r > Xi^ u ... -\- Xi, n — 1. 

With the same argumetation and the fact that ay it = 0 Vt > Ai, it can be 
proven Xi t t = 0 t = l + 1, ..., Ai where Z = Ai — a(vi). □ 
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Lemma 2 . max(a, |"|V|/ct]) < A* < T* . 

Proof. Let X = (27,1, ...,x n>n ) £ V{\*). 

— Suppose V(a — 1) ^ 0. Then VA £ P(a — = 0 Vu* £ V,Vt > a. Let 

CP = (..., Uj), therefore a(vj) = a. From lemma 1 we know Xi t = 0 Vt < a 
and therefore Xij, = 0 Vt £ F, which is a contradiction to assignment 
constraints. Thus, P(a — 1) = 0 and a < A*. 

— Let S* = ...,x* n ) be an optimal schedule. Obviously S* £ LP(1). 

x* t ~ 0 Vuj £ V,\/t > T* => S* £ V{T*). Since A* is the smallest integer 
s.t. V(X*) is not empty, therefore A* < T*. 

— From resource constraints we have 'Yhv-ev x ht < o Vt £ P. Xi t t = 0 Vt > A*, 
therefore '}2 ter 'ffy . eV x i.t — a X*. This alongside with assignment con- 
straints will give \V\ < crA*. Since A* is integer, we get |"|V|/cr] < A*. 

□ 

Theorem 1. max(\(Y,l= 1 + (7 - 1), KELi \ L k\)/cr] + (a - 7 )) < A* 

for 7=1, ..., a. 

Proof. Let V\ = U^ =T t7fc, V 2 = V\Vi and X = (27,1, ..., x n , n ) £ V{\*). From 
the definition of Uk we have a(vi) > 7 V17 £ Vi. This and lemma 1 result 
Xi >t = 0 Vu,: £ Vi, Vt < 7. 

Let’s decompose G into Gi = (Vi,Pi) and G 2 = Lemma 2 states 

that A *(G 2 ) >7—1, therefore 

A* = A*(G) > 7 - 1 + A*(Gi) 

because = 0 Vr>,; £ Vi,Vt < 7. Since A*(Gi) > |"|Fi|/ct] we get the result. 
The other case can be proven similarly. □ 



3 Hu’s Level Algorithm(HLA) 

Up to now, we have found a lower bound for A* and T* . In this section, we 
investigate the tightness of this bound. To do so, we modify HLA [7] on intrees 
and show that the optimal schedule obtained with this algorithm has makespan 

max ( r (Efe= 7 \Uk\)M + (7 - 1), FQXi \Lk\)M + (a - 7)) = X* =T* for 
7= 1, ..., a. 

Let G = (V, E) be an intree and L k for k = 1, ..., a are given. A starting node 
is a node with no predecessor in G. 

The algorithm ’’executes” L \, ..., L a starting from the smallest indeces. More 
precisely, suppose Li, ... : Lk-i have already been executed. Lk is executed as 
follows, a arbitrary nodes from Lk are scheduled at the current time-step(l in 
the beginning) and removed from Lk and G; and the time-step is incremented 
once. The same procedure is done 0 < \Lk\ < a. If \Lk\ = 0 the execution of Lk is 
completed. Otherwise the algorithm schedules starting nodes from the successive 
level(s) of Lk with maximum a(v) until a nodes are scheduled at the current 
time-step or no more starting node exists. 
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Input: an intree G = (V,E); 
t = 1; k = 1; 

While k < a do 

{ 

X t = arbitrary a elements of L*,; 

E t = edges adjacent to the nodes in X t \ 

G = (V\X t ,E\E t )-, 

Ek = Ek\Xf/. 

If (|Ai t | < cr) then 

{ 

X t = X t U {a — |X t | starting nodes, v, with maximum a(t;)}; 

Remove all of these starting nodes, v, from Li and G where v £ Li; 

} 

If (\L k \ == 0) then k + +; 
t H — h; 

}; 

T' = t - 1; 

Output: X t = the set of nodes scheduled at time-step t = 1, . . . , T' . 

Figure 1 gives an intree and a schedule as Gantt chart (the tth column shows the 
nodes in X t ). 




Fig. 1. 
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Using HLA, a schedule X = ( 0 : 1 , 1 , • • • ,% n , n ) where Xij, = 1 if Vi £ X t and 
Xi t t = 0 otherwise, and T' are obtained. Now we prove |"(X]fc = 7 |Lfc|)/cb| + {ot — 
7 ) = T' , which implies A* = T' = T*\ therefore, first, HLA gives an optimal 
schedule for MPSP on intrees and second, A* is tight. The next lemma is needed 
to prove this. 

Lemma 3. In the solution retrieved by HLA on G=intree, |A t+ i| < \X t \ < o 
for all t = 1, . . . , T' — 1. Furthermore, if |A t | < a for any t = 1, . . . , T' , then 
3t> £ Xt s.t. t = T' — a(v). 



This means for any v' £ A t+ iU. . .U Xt>, there exists v £ X T s.t. v £ Pred{v'). 

Proof. Obviously |X t | < cA/i = 1,...,T'. Let r be the smallest time-step for 
which |A r | < a. Since G is an intree, therefore the set of immediate successors 
of the tasks in X T has at most \X T | members and consequently, X T+ \ has at most 
\X T \ members. Similarly, we can prove |X t+ i| < \X t \ < a for t = 1, . . . , T' — 1. 

As a result, \X t \ < a for t = r, ...,V . This means for any w' £ X t+ i there 
exists w £ X t s.t. ( w , w') £ E for t = r, . . . , T' — 1 which means there exists a 
path (v t , ■■■ , Vt') with length T' — t where v t £ X t for t = r, . . . , T' . Therefore 
3v t £ X t s.t. a[v t ) > T' — t for t = r, ...,T r . Additionally, a(vf) > T' — t is a 
contradiction because in this case, v t cann’t be scheduled at time-step t. Thus 
3v t £ X t for allt = r, . . . , T' s.t. t = T' — a(y t ). |A t | = a for t < r, so the proof 
is complete. □ 

Theorem 2. G = intree: |"Q3fc=i l-^fcl)/ 17 ! + (a — 7 ) = A* = T* , 

G = outtr ee: KEL 7 \ u k\)/ a \ + (7 - 1) = A* = T* 

for 7 = 1, ..., a. 

Proof. Let X t for t = 1 be the output of HLA algorithm and r be the 

smallest time-step that £ X T s.t. r = T' — a(v). Let a(v) = 0 — 7 , therefore 
T' = r + a — 7 . Obviously: 

— a(vi) < a(v) => a — a{vf) > a — a(v) = 7 Vvi £ X t Szt > r. 

— > Qtfy) => a — a{vf) < a — a(v) = 7 Vv , £ X t Szt < r. 

As a consequence, U ^ =1 Lfc = {vi\vi £ Xfit < r} U {vi\vi £ X T $za(vi) = a(u)}. 
|{wi|vi £ X t \/t < r}| = (r — 1) x o otherwise 3X t s.t. |X t | < cr for t < t and 
according to lemma 3, 3v £ X t s.t. t = T' — a(v) which is a contradiction to the 
fact that t is the smallest time-step with this property. 

Furtheremore, let \{vi\vi £ X T Sza(vi) = a(u)}| = m, where m < 0 . This 
means | U^ =1 L k \ = (r - 1) x <7 + m => | U^ =1 L k \/o = (r - 1) + m/o => 
[| U2 =1 L k \\/<J = t. Since V = r + a — 7 , the proof is complete. 

The case of outtrees is proven similarly. □ 

As a result, the time complexity to find the makespan of P\intree(outtree),Pi = 
MCmax iS O(PLP). 




